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We consider the thermodynamics of chemical coupling from the viewpoint of free energy transduction efficiency In 
contrast to an external parameter-driven stochastic energetics setup, the dynamic change of the equilibrium distribution 
induced by chemical coupling, adopted, for example, in biological systems, is inevitably an autonomous process. We 
found that the efficiency is bounded by the ratio between the non- symmetric and the symmetrized Kullback-Leibler 
distance, which is significantly lower than unity Consequences of this low efficiency are demonstrated in the simple 
two- state case, which serves as an important minimal model for studying the energetics of biomolecules. 
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Introduction. — Biological phenomena are based on nano- 
micron- scaled mechanics and reactions. Physics of the fun- 
damental processes occuring inside cells, such as transcrip- 
tion/translation dynamics or motions of molecular motors 
and ion pumps,^'^^ should all be based on small-system's ther- 
modynamics. Recent developments in the study of thermo- 
dynamics on this scale, including non-equilibrium work rela- 
tions,"^"^^ treatments of feedback control,^' and generalized 
fluctuation-dissipation relations, are well supported by 
experimental techniques at the single-molecule level. How- 
ever, the direct relationship between the stochastic thermo- 
dynamics scheme^^"^^^ and the actual biological reactions is 
unclear, and the physical design principles of biomolecular 
dynamics remain a challenge. 

A large gap exists in the treatment of external parameter 
between the knowledge of stochastic thermodynamics and ac- 
tual biophysical reactions. In a typical setting, such as cases 
of the Jarzynski equation"^^ and the fluctuation theorem, a set 
procedure of externally switching the parameter commonly 
written as A is considered. Such non- fluctuating external con- 
trol is experimentally achieved by the intervention of a macro- 
scopic setup, as in the case of laser traps and magnetic or 
electric fields acting on small beads.^'^' On the other hand, 
biomolecular dynamics is typically autonomous with only 
limited ability to control the probabilities of desired and un- 
desired events. In an autonomous and substantially isothermal 
system, the source of this operation must suffer the same order 
of thermal fluctuations as the target, thus forcing biological 
systems to adopt a chemical coupling strategy. 

Out-of-equilibrium free energy is the source of chemical- 
coupling-driven control. Altering equilibrium situations in a 
successive manner for producing irreversible dynamics shall 
be physically viewed as a free energy transduction phenom- 
ena. This is significant in that delivering free energy by this 
way is different to simply treating chemical energy as a source 
of force and thermodynamic work. Specifically, transduction 
efficiency in such a scheme may not, in principle, reach the 
second law limit as is the case with the proposed operational 
setup. 

In this letter, we discuss the thermodynamics of such au- 
tonomous free energy transduction. We consider the general 
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case of altering an equilibrium distribution for achieving a 
new equilibrium situation through a chemical coupling pro- 
cedure, and derive a bound on its efficiency (Eq. (1)). Result- 
ing expressions quantify the intuition of the efficiency falling 
significantly below the second law bound. The substantial re- 
duction in efficiency is demonstrated for a specific case of the 
two- state model. 

Efficiency of free energy transduction. — We set up a sys- 
tem that undergoes Markov transitions between discrete en- 
ergy (or constrained free energy) states. /, (= 1, • • • ,N). We 
consider linking this system to a chemical potential reservoir 
(i.e., the outer setup) and transducing free energy into it by al- 
tering its detailed balance condition. Initially, the system is 
isolated from the chemical potential bath, characterized by 
the probability distribution [pi) (pi = e~^^' /Z), over the states 
with energy Ui in thermal equilibrium at constant temperature 
J3~^(Z = Yji e~^^')- For reaching the new distribution, {^/}, the 
system is then placed in contact with the chemical bath in 
which the transition rates are associated with coupled chem- 
ical reactions. Comparing the free energy gain in the system, 
AF, with the free energy consumed in the outer setup (chem- 
ical baths), AFc, we determine that the efficiency of free en- 
ergy transduction cr/ is bounded by an inequality. 



AF 



D(q\\p) 



AFc - D{q\\p) + D{p\\q) 



< 1. 



(1) 



Here D{q\\p) is the relative entropy, or the Kullback-Leibler 
distance between the distributions [qi] and 

Z)(^||;7)^y^aog->0, (2) 

assuring the second inequality to hold. The equality of the first 
inequality in Eq. (1) is met for the case of perfect coupling, 
where the chemical potential of coupled reaction contributes 
100% in altering the balance in the system. This is a realizable 
situation in real systems as opposed to the slow and determin- 
istic operation limit ct/ ^ 1. Thus, Eq. (1) states the existence 
of a reachable bound in autonomous free energy transduction 
efficiency, which is more restrictive than the limit of the sec- 
ond law. 

To derive Eq. (1), we first examine the free energy gain of 
the system, AF. Given {[//}, the Gibbs free energy difference 
of the system's probability distribution to be found as [qi] in- 
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Fig. 1. (color online). Scheme of revising the distribution of the system 
with energy states {Ui}. (a) The original detail balanced transitions Wi^j 
(blue arrows, Eq. (6)), and the equilibrium distribution {pi} (blue clouds), (b) 
Chemical reactions (red, Eq. (5)) are coupled to the original detail balanced 
transitions to effectively change the transition rates, (c) Original distribution 
is altered and equilibrates to a new distribution {qt} (green clouds), because 
of new transition rates w'j^j (green arrows, Eq. (7)). For the system this will 
be a free energy gain of amount D(q\\p) (Eq. (3)) and for the outer setup (con- 
taining the coupled reactions) the loss of at least D(q\\p) + D(p\\q) (Eq. (10)). 



Stead of {pi} can be quantified as,^^^ 

PAF =pYj(qi - PiWt - [S(q) -S(p)] = D(q\\p), (3) 

where the Shannon entropy is written as 5" (/?) = - 2 Pi log Pi. 
Here because the relative entropy is non-negative (0 if and 
only if qi = pi for all /), the equilibrium distribution [pi] gives 
the free energy minimum. Relative entropy measures the dis- 
tinguishability of the two probability functions (Sanov's the- 
orem^^'^^^), showing how unusual it is to find the distribution 
[qi] when {/?/} is expected. 

Next we derive the free energy cost, AF^, consumed in the 
outer setup, which is required for the system to obtain such 
free energy gain. The outer setup that links to the system con- 
sists of chemical species {A^^, B'^} with concentrations {[A^^], 
[B^^]}. Chemical reactions coupled to the transitions between 
the states in the system are defined as (see fig. 1) 



state / -h A'"^' ^ state j -h B'"^'. 



(4) 



w^_^^. are the new Markovian transition rates between energy 
states (/, 7), including the eff'ect of the coupled chemical reac- 
tions. The chemical potential (i.e., Gibbs free energy) change 

p^ij - A/iij, B'^ A'^ - Afiji, (5) 

in the dilute limit is Afiij = -Ajdji = AjJ^j -h JS'^ log where 
AjJIj is the standard free energy diff'erence of A^^ and B'^ . Note 
that we are considering the temperature J3~^ as being constant 
throughout. We assume that there are a sufficient number of 
molecules {A'^ , B'^ } and that the non coupling reactions A'^ 
B'^ are slow enough, A/Jij does not change throughout the time 
period of interest; in other words, {[A^^], [B^^]} is fixed. Thus, 
our outer setup containing molecules {A^^, B'^} serves as the 
chemical potential bath. In reality, the number of molecules 
in the reactions may not be conserved, as in the case of ATP 



ADP-hPi. However this does not affect the free energy cost, 
and therefore we may think of reactions (4) without the loss 
of generality. 

Coupling reactions with this outer setup alter the detailed 
balance condition of the system. Considering the initial equi- 
librium setup, detailed balance between the original Marko- 
vian transition rates of the system w/^y, should satisfy 



(6) 



New transition rates in the system after being coupled to the 
outer setup reactions w^_^^. will be altered from Eq. (6), and 
will satisfy the relations described using the eff'ective coupling 
chemical potentials fiij. 



(7) 



The effective couplings piij for attaining the new distribution 
{qi} under the conditions of the original distribution being {/?/} 
and the new balance condition being Eq. (7) are determined 
by 



Pi 



(8) 



Note that fiij = Ajiij does not necessary hold, but in general 
< fiij/A/^ij < 1. As will be discussed in the last part of this 
section, in some contexts efficiency is defined as this coupling 
perfection flij/Ajiij, which is related to-but diff'erent from-the 
efficiency of free energy transduction (1). 

Before we derive AFc, a few remarks will elucidate our 
setup of coupling reactions at this point. In general, uncoupled 
original transitions of rate Wi^j may coexist with coupled re- 
actions, but here we are interested in the case wf_^ . » w/^ , 
where coupled reactions are much more likely to occur than 
the original transitions. 

Uncoupled transitions may occur, but these will only lead 
to additional consumption of chemical potential, thus reduc- 
ing the efficiency (without affecting our final result concern- 
ing efficiency bounds). We also assume that the steady state 
of the new dynamics drives no current for the time scale 
of interest because our consideration is an equilibrium-to- 
equilibrium transition. The no-current condition may be sat- 
isfied, for example, when any closed path of fast (dominant) 
reactions i ^ j ^ • • • ^ k ^ i gives the sum of poten- 
tial changes jlij -\- - - - -\- flki = 0. This is somewhat artificial 
restriction for an N state model; however, in the two- state 
case N = 2, where there is no restriction since it is always 
fin +/i2i = 0. 

With these assumptions we quantify the overall free energy 
consumption in the outer setup. 



l<i<j<N 



(9) 



Here, riij represents the net transitions between the system's 
states / and j (coupled to A'^ B'^ in the outer setup) that 
occurred up to equilibration. Given Ui and fiij will not deter- 
mine the details of the Markovian dynamics of equilibration, 
including riij, because only the ratios between w^_^^. and wj^. 
are known and not their absolute values. However, AFc will be 
bounded from below by YuiKj^ijf^ij because each term in the 
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sum is positive and < flij/Ajiij < 1. According to our setup, 
Hij should satisfy 2/ ^ij = - Pj and riij = -riji. Thus, this 
lower bound may be expressed as a symmetrized Kullback- 
Leibler distance with no dependence on the detail of riij, 



fiAF, 



l<i<j<N 



l<iJ<N 



= Yiqi - Pi) log - = D{q\\p) + D{,p\\q). (10) 
i P' 

Equality holds when fiij = Ajiij for all (/, j), which is the per- 
fect coupling case. Free energy gain Eq. (3) and the minimal 
cost Eq. (10) gives our result of the efficiency bound Eq. (1). 

The physical reason for the appearance of the symmetrized 
Kullback-Leibler distance may be explained as follows. The 
second term in Eq. (10), D(p\\q) > 0, is the extra free energy 
consumption, because Eq. (3) expresses the free energy gain 
in the system by the transition {pi} {qt}. As observed from 
the new equilibrium {^J, the distribution being {pi} holds a 
higher free energy of fi~^D(p\\q), because this is the opposite 
of Eq. (3). From this point of view, {pi} {qi} is merely a 
relaxation process; hence, the additional term in Eq. (10) ap- 
pears as a result of unutilized and dissipated extra free energy. 
This means that to transduce j3~^D(q\\p) of free energy from 
the non-equilibrium chemical bath (i.e., the outer setup) to 
the system by the coupling scheme, there is an accompanying 
dissipation of at least l3~^D(p\\q) for fulfilling the free-fall pic- 
ture {pi} {qi}. Dissipating energy should be supplied by the 
free energy of the chemical bath; thus, we have the additional 
symmetrical term appearing in Eq. (10). Note that for the case 
D(p\\q) / D(q\\p) 0, the equality of the second inequality in 
Eq. (1) will be met, however this occurs only in a specific sit- 
uation of an infinitely large free energy transduction, as will 
be seen in the next section for the = 2 case. 

In theory, efficiency CTf could reach 1 in the quasi- static 
regime of operational thermodynamics. If we hypothetically 
consider the external chemical potential as a tunable parame- 
ter and slowly vary it from to fiij, the free energy cost in the 
outer setup will be 



dx log — 

Pi 



= D(q\\p) = /3AF, 



qi log — -h Pi 

Pi 



(11) 



where the extra cost is eliminated because of the quasi-static 
operation and thus ct/ = 1. In the chemical coupling scheme, 
however, the inevitable dissipation D(p\\q) accounts for the 
spontaneous progress of the reaction. 

We emphasize that the equality of the first inequality in 
Eq. (1) is an obtainable bound in real autonomous systems, 
in contrast with the second law bound that requires an oper- 
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Fig. 2. (color online). Two-state case of free energy transduction (see 
Eq. (12)). Distribution p : 1 - p is changed io q : 1 - ^ by the coupled 
chemical potential A//. . 
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Fig. 3. Transduced free energy and the efficiency according to the design 
of the two-state model (AU of fig. 2). (a) Gained free energy in the system 
with fixed chemical potential A// = 50, 20, 10, 5, 2 kBT, on the order of the 
height of the peak, (b) Efficiency of free energy transduction (1) for Ayu = 
20, 10, 5, 2 In both figures the gray line corresponds to the limit fiA/i 



ational scheme before it can be reached. For instance, when 
the stall force of processive molecular motors are compared 
to ATP hydrolysis free energy, one might think of this effi- 
ciency, because in such cases, the new balance Eq. (7) is rela- 
tive to the free energy consumption Aji of a single molecule. 
High coupling efficiency, corresponding to fiij/Ajiij ~ 1, has 
been observed in experiments on molecular motors such as 
the Fl-ATPase,^^^ and perfect coupling is thought to be pos- 
sible in maximally efficient biological reactions. However, it 
is important to mention that perfect coupling leads only to the 
equality of the first inequality in Eq. (1), and does not guaran- 
tee that CTf = 1. In other words, perfect coupling is the most 
efficient way of transduction for autonomous systems where 
optimal controls such as quasi- static manipulations do not ex- 
ist. 

Two-State Model — Here we investigate the quantities 
given in the last section, for the N = 2 case. In fact, most bio- 
logical reactions are basically two- state models with a chem- 
ical potential bath. Typical examples include molecules tran- 
sitioning to each other as in high-energy phosphate reactions, 
conformational states in proteins as in molecular motors/ion 
pumps and various enzymes, or chemical potential differences 
across a membrane.^' ^' 

Let the system initially be at probabilities p \ 1 - for the 
state- 1 and state-2 with the (free) energy difference between 
the states being /3AU = log ^ (see fig. 2). For the system 
to reach a new equilibrium with probabilities q \ 1 - ^, the 
chemical potential change in the coupling reaction must be 
a certain amount -flu = flu - Ayu, considering the perfect 
coupling case. An average number -n\2 - n2i = q - p of 
molecules will be consumed in the chemical potential bath; 
thus, 

PAF = D(q\\p) = ^log ^ + (1 - ^)log 

P ^-P 
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Fig. 4. Efficiencies (13), (15) and the optimal At/ (16). o-g and AU/x are 
the ordinate and abscissa, respectively, of the peaks in fig. 3 (a), and dy is the 
AU/A/j. oo limit in fig. 3 (b) 



log 



q(l-p) 



D(q\\p) + D(p\\q) 



(q - p)A/2. 



(12) 



For a fixed Ayu, received (AF) and consumed (AFc) free ener- 
gies, change according to the initial setting of the system (AU 
in fig. 2). In fig. 3, we plot AF and the free energy transition 
efficiency ct/ as a function of AU. Assuming Ayu > with- 
out the loss of generality, cr/ is a monotonically increasing 
function of AU approaching 



CTf = 1 - - -h 

X 



1 



< 1, 



(13) 



- 1 

where x = jSAji and for At/ oo giving the upper bound of 
CTf (fig. 4). Only in the case of Ayu ^ oo does CTf reach 1, 
because CTf <oy for all At/. In fact, the condition for cr/ = 1 
is AU/Afi > 1 with jSAji oo (see the gray plot in fig. 3 (b)). 

Another efficiency of interest is the maximal free energy 
that could be transduced out of the given chemical potential, 

maxAf/ AF 



(14) 



which is the peak value of each of the plots in the fig. 3 (a). 
Because AFc < |Ayu|, we see that o-g < o-f. The explicit ex- 
pression as a function of x = pAji can then be derived; 



o-g{x) = 



1 



1 



1 



log- 



l-e- 



- 1 



where the maximum of AF is given at 

xe^ -\- I - 



PAU = AU(x) = jc - log ■ 



- 1 - X 



(15) 



(16) 



From these expressions, both functions crg(x) and AU(x)/x 
are found to be smaller than 1, tending to 1 - logx/x for 
large enough x, as plotted in fig. 4. Consequently, we see 
(Tg reaching as low as ~ 0.8 in the case of A/i ~ 20k bT, 
which is thought to be the ATP hydrolysis free energy in a 
typical intracellular culture, and less than 0.9 even in the case 
of Ajd ~ 50k bT , which is the maximum energy scale of single 
molecular biochemical reactions (fig. 4). This shows the inef- 
ficiency of transmitting finite free energy from the outer setup 
to the system by a non-operative procedure. The expression 
of AU{x) provides an idea for the design of an ideal free en- 
ergy transduction: the optimal two-molecular state system for 
transducing a free energy Ayu is a system with a standard free 
energy difference AU . This design principle may be adopted 



in biological systems, for example, in the metabolic pathway 
where free energy may not be wasted in successive transduc- 
tions or in the signal transduction pathway where information 
must be transmitted with high efficiency. 

In summary, we derived the explicit formula of the free 
energy transduction efficiency limit as Eq. (1) in a chemi- 
cal coupling regime. The symmetrized Kullback-Leibler dis- 
tance in Eq. (10) lowers the bound of efficiency by a non-zero 
counter term, which appears as a consequence of the proce- 
dure of free energy transduction being autonomous. For the 
two-state model, derived expressions of maximal efficiencies 
were shown to remain low for finite free energy cases, and 
the situation of optimal transduction was pointed out for its 
promise for research in real biological systems. 

We believe the efficiency bound (1) could be derived for 
various setups as in the case of non-equilibrium work rela- 
tions, "^"^^ because the reason for the symmetrized Kullback- 
Leibler distance to enter the formula seems sufficiently gen- 
eral. 

Our view shows the importance of distinguishing between 
the ultimate bound of the second law, which can be achieved 
only in the macroscopically/quasi-statically operating case, 
and the realistic tighter bound imposed on autonomous sys- 
tems. Because the loss of free energy in the form of AFc - 
AF > P'^D^pWq) will accumulate in the case of successive 
transduction, it should be interesting to learn how biochemi- 
cal networks maximize its eflaciency of information/free en- 
ergy transmission in their series of reactions. 
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